BioNLP'09 Shared Task on
Event Extraction
in conjunction with
BioNLP, a NAACL-HLT 2009
workshop, June 4-5 2009, Boulder, Colorado
Final Evaluation Results
on ALL-TOTAL events by Ev. Decom. - Approx. Recur. matching
Task 1
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------
[ UTurku ] ==[ALL-TOTAL]== 3520 ( 1597) 2717 ( 1597) 45.37 58.78 51.21
[ConcordU ] ==[ALL-TOTAL]== 3520 ( 1288) 1993 ( 1288) 36.59 64.63 46.73
[JULIELab ] ==[ALL-TOTAL]== 3520 ( 1513) 3077 ( 1513) 42.98 49.17 45.87
[UT+DBCLS ] ==[ALL-TOTAL]== 3520 ( 1307) 2311 ( 1307) 37.13 56.56 44.83
[VIBGhent ] ==[ALL-TOTAL]== 3520 ( 1181) 2095 ( 1181) 33.55 56.37 42.07
[ UTokyo ] ==[ALL-TOTAL]== 3520 ( 981) 1844 ( 981) 27.87 53.20 36.58
[ UZurich ] ==[ALL-TOTAL]== 3520 ( 977) 1853 ( 977) 27.76 52.73 36.37
[ UNSW ] ==[ALL-TOTAL]== 3520 ( 973) 1957 ( 973) 27.64 49.72 35.53
[ Cam ] ==[ALL-TOTAL]== 3520 ( 737) 1199 ( 737) 20.94 61.47 31.24
[UAntwerp ] ==[ALL-TOTAL]== 3520 ( 786) 1585 ( 786) 22.33 49.59 30.79
[ASU+HU+BU] ==[ALL-TOTAL]== 3520 ( 705) 1107 ( 705) 20.03 63.69 30.47
[ SCAI ] ==[ALL-TOTAL]== 3520 ( 866) 2313 ( 866) 24.60 37.44 29.69
[ UNIMAN ] ==[ALL-TOTAL]== 3520 ( 728) 1444 ( 728) 20.68 50.42 29.33
[ Team 24 ] ==[ALL-TOTAL]== 3520 ( 772) 1749 ( 772) 21.93 44.14 29.30
[ USzeged ] ==[ALL-TOTAL]== 3520 ( 726) 1852 ( 726) 20.62 39.20 27.03
[ UAveiro ] ==[ALL-TOTAL]== 3520 ( 634) 1363 ( 634) 18.01 46.52 25.97
[ NICTA ] ==[ALL-TOTAL]== 3520 ( 652) 1542 ( 652) 18.52 42.28 25.76
[CNBMadrid] ==[ALL-TOTAL]== 3520 ( 1098) 5700 ( 1098) 31.19 19.26 23.82
[CCP-BTMG ] ==[ALL-TOTAL]== 3520 ( 446) 606 ( 446) 12.67 73.60 21.62
[CIPS-ASU ] ==[ALL-TOTAL]== 3520 ( 747) 3827 ( 747) 21.22 19.52 20.33
[ UMich ] ==[ALL-TOTAL]== 3520 ( 1118) 7637 ( 1118) 31.76 14.64 20.04
[ PIKB ] ==[ALL-TOTAL]== 3520 ( 376) 552 ( 376) 10.68 68.12 18.47
[ Team 09 ] ==[ALL-TOTAL]== 3520 ( 417) 1278 ( 417) 11.85 32.63 17.38
[ KoreaU ] ==[ALL-TOTAL]== 3520 ( 315) 499 ( 315) 8.95 63.13 15.68
Task 2
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------
[UT+DBCLS ] ==[ALL-TOTAL]== 3716 ( 1369) 2398 ( 1369) 36.84 57.09 44.78
[ Team 24 ] ==[ALL-TOTAL]== 3716 ( 829) 1826 ( 829) 22.31 45.40 29.92
[UAntwerp ] ==[ALL-TOTAL]== 3716 ( 796) 1610 ( 796) 21.42 49.44 29.89
[ASU+HU+BU] ==[ALL-TOTAL]== 3716 ( 705) 1107 ( 705) 18.97 63.69 29.23
[CNBMadrid] ==[ALL-TOTAL]== 3716 ( 1183) 6711 ( 1183) 31.84 17.63 22.69
[CCP-BTMG ] ==[ALL-TOTAL]== 3716 ( 463) 623 ( 463) 12.46 74.32 21.34
Task 3
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------
[ConcordU ] ==[ALL-TOTAL]== 3941 ( 1354) 2129 ( 1354) 34.36 63.60 44.61
[VIBGhent ] ==[ALL-TOTAL]== 3941 ( 1222) 2258 ( 1222) 31.01 54.12 39.43
[ASU+HU+BU] ==[ALL-TOTAL]== 3941 ( 727) 1186 ( 727) 18.45 61.30 28.36
[ NICTA ] ==[ALL-TOTAL]== 3941 ( 671) 1612 ( 671) 17.03 41.63 24.17
[ USzeged ] ==[ALL-TOTAL]== 3941 ( 761) 3113 ( 761) 19.31 24.45 21.58
[CCP-BTMG ] ==[ALL-TOTAL]== 3941 ( 465) 787 ( 465) 11.80 59.09 19.67